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Abstract. The paper deals with totally geodesic Radon trans- 
forms on constant curvature spaces. We study applicability of the 
historically the first Funk-Radon-Helgason method of mean value 
operators to reconstruction of continuous and functions from 
their Radon transforms. New inversion formulas involving Erdelyi- 
Kober type fractional integrals are obtained. Particular emphasis 
is placed on the choice of the differentiation operator in the spirit 
of the recent Helgason's formula. 



1. Introduction 

Inversion of Radon transforms is one of tlie central topics of integral 
geometry [GGG, GGV, He]. The method of mean value operators, 
when the unknown function is reconstructed from its spherical mean, 
was suggested by Funk [Fll, F13] for circular transforms on the 2- 
sphere. It was adapted by Radon [R] for hyperplane transforms, and 
extended by Helgason [He] to totally geodesic transforms on arbitrary 
constant curvature space in any dimension. 

In most publications the method of mean value operators is ap- 
plied to infinitely differentiable rapidly decreasing functions. Below 
we investigate applicability of this method to arbitrary continuous and 
LP functions. As in the original works by Funk and Radon, we in- 
voke Abel type integrals, which are basic objects of Fractional Calcu- 
lus [Ru96, SKM]. Using tools of this branch of analysis, we show 
that the Funk-Radon-Helgason method can be successfully applied to 
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derive new inversion formulas, which work well when "standard" pro- 
cedures are inapplicable because of insufficient decay of functions at 
infinity or lack of smoothness. Importance of fractional integration in 
integral geometry was pointed out in a series of publications; see, e.g., 
[Gi, Ru98]. 

A customary ingredient of the method of mean value operators 
for the Radon transform ip = Rf over /c- dimensional totally geodesic 
submanifolds is differentiation of form d/dr"^ . For example, if k is even, 
then 

(1-1) ^^^^-""'"^"{-d^) ^^>^^'i^o^ 

cf. [Ru04b, p. 113] for the A;-plane transform on or [He, p. 128] 
(with minor changes) for the similar transform on the hyperbolic space. 
Here (/?*(/?) (r) is a certain mean value of (/?, which is called the shifted 
dual Radon transform [Rou] (precise definitions will be given later). 
A remarkable observation by Helgason [He, p. 116] is that for an even 
k, to reconstruct / from the fc-plane transform (p = Rf, it suffices to 
differentiate in r, rather than in r^. Helgason's result reads as follows: 



(1.2) f{x) = Ck 



dr 



Ck — const, k even. 



=0 

In the present article we show that compositions of the Erdelyi-Kober 
type fractional integrals with power weights yield more inversion for- 
mulas with "usual" differentiation [d/dr)^. This is done for totally 
geodesic transforms in all dimensions on arbitrary constant curvature 
space and under minimal assumptions for /. 

Pointwise inversion of Radon-like transforms of nonsmooth func- 
tions with minimal assumptions at infinity was studied in [BR04, 
Ru02a, Ru02b, Ru04a, Ru04b, So, Str], where one can find further 
references. Methods of these papers mainly deal with different kinds 
of singular integrals, wavelet transforms, and Ricsz potentials. To the 
best of our knowledge, applicability of the method of mean value op- 
erators (which is historically the first) to such "rough" functions was 
not investigated before. The differentiation issue related to (1.2) is 
especially appealing. Some Radon inversion formulas with "usual" dif- 
ferentiation, but for smooth rapidly decreasing functions, were obtained 
in [AR, Mj. The method of these papers differs from ours in principle. 

Plan of the paper. Section 2 contains necessary preliminaries 
from Fractional Calculus. Sections 3,4, and 5 deal with totally geo- 
desic Radon transforms on the Euclidean space R", the n-dimensional 
hyperbolic space H", and the unit sphere S'^, respectively. In Section 
6 we give detailed proof of the Helgason's formula (1.2), evaluate the 
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constant Ck (that was not done in [He]), discuss related results and 
open problems. 

Notation and conventions. In the following (T„_i = 27r"/^/r(n/2) 
is the area of the unit sphere S*"^^ in R"^; Ci, . . . , e„ are coordinate unit 
vectors; o is the origin of M". We say that / is a locally integrable 
function on R+ = (0, oo) (resp., on \ {o}), if it is Lebesgue inte- 
grable on any interval (a, 6), < a < 6 < oo (resp., on any shell 
< a < |x| < 6 < oo). The letter c stands for a constant, which can 
be different at each occurrence. More notation will be introduced in 
due course. 



2. Preliminaries from Fractional Calculus 

We recall basic facts about fractional integration and differentiation 
with the main focus on integral-geometric applications in subsequent 
sections. More information can be found in [Ru96, SKM]. 

2.1. Riemann-Liouville fractional integrals. For a sufficiently 
good function / on R_|_ = (0, oo), we consider two types of the Riemann- 
Liouville^ fractional integrals of order a > 0: 



1 / mds fra 1 / f{s)ds 

r(a)J (t-sy-' r{a)J {s-ty-- 



Existence of /"/ essentially depends on the behavior of / at infinity. 

Lemma 2.1. Let f be a locally integrable function on M_|_. Then 
{I-f){t) is finite for almost all t > provided 

/oo 
|/(s)|s"-^ds < oo. 

/// is non-negative and (2.1) fails, then {I^f){t) = oo for every t > 0. 

Proof. Note that the lower limit of integration in (2.1) can be 
replaced by any number a > 0. To prove the first statement, it suffices 
to show that 

b 



I 



{r\fmdt <oo 



^In many publications /"/ is called the Weyl fractional integral. However, 

Weyl's publication is dated by 1917 and focused on periodic functions, while Liou- 
ville's work, dealing with such integrals, was published in 1832; see historical notes 
in [SKM]. 
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for any < a < 6 < oo. This can be done by changing the order of 
integration and using (2.1). To prove the second statement, we assume 
the contrary, that is, (J"/)(t) is finite, but (2.1) fails. Choose any a > t 
and A'" > 0, and let first a < 1. Since (s — i)^~" < then 



f{s)ds ^ r^"" f{s)ds ^ r^^'mds 

^ ur-i:m 

UN ^ oo, then, by the assumption, the left-hand side remains bounded 
whereas the right-hand side tends to infinity. For a > 1, we proceed 
as follows: 



i-2a+N i-2a+N 

/ {s-tr-'f{s)dy > / {s-tr-'f{s)dy 

Jt J2a 



i'2a+N p2a+N 

ha 

p2a+N 

> 2^-" / s''-^f{s)ds 

J 2a 

(note that s — t>s — a>s/2). The rest of the proof is as above. □ 
Changing the order of integration, we easily get 

(2.2) iiiif = i^-^^f, r t-"-^ i^f = t-^ r'^f, 

provided that integrals in either side exist in the Lebesgue sense. Here 
and on, powers of t stand for the corresponding multiplication operators 
(instead of t there may be another letter). The second equality can be 
alternatively derived from = I"^^f if we replace variables by 

their reciprocals. 

Fractional derivatives V'^ip of order a > are defined as left inverses 
of the corresponding fractional integrals, so that 

(2.3) V^I^f = /. 

Operators may have different analytic forms, depending on the class 
of functions. For example, if a = m + aQ, m = [a], < ao < 1; then 

(2.4) V^ip = (±d/di)"^+i74-"V- 

The existence of the fractional derivative and the equality (2.3) must 
be justified at each occurrence. 
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2.2. Modified Erdelyi-Kober fractional integrals. There ex- 
ist many modifications and generalizations of the Riemann-Liouville 
integrals, for instance, 

t oo 

fr fm-^ fj{s)sds_ f)(t)-^ fj{s)sds_ 

t 

We call 2/ ^he modified Erdelyi-Kober fractional integrals. They 
differ from the classical Erdelyi-Kober integrals, as in [SKM, Sn], by 
weight factors. Clearly, 

(2.5) IlJ^A-'l^Af, {Af){t) = f{Vt). 

The following statement is a consequence of Lemma 2.1: 

Lemma 2.2. Let f he a locally integrable function on M+. Then 
(7° 2/)(0 finite for almost all t > provided 



(2.6) 1 1/( 



If f is non-negative and (2.6) fails, then (/^ 2/)(^) — °° fof every t>0. 

Lemma 2.3. The following formulas hold provided that integrals on 
the right-hand side exist in the Lehesgue sense: 

(2.7) Il,li,2f = 

(2.8) r ,2 ^"'""'^ I-,2f - ^"'^ 1-%^ t''""f- 

(2.9) t r 2 ^"^""^ ^",2/ = 22"/2"/, 2 ^^,2/ = 2^"/+" t /. 

Proof. Owing to (2.5), the first two formulas are immediate con- 
sequences of (2.2). To prove the first formula in (2.9), we change the 
order of integration and get 



where 



4 /"°° 

l.h.s. = / f{s) I{s, t) ds, 



I{s, t^st I {s^- ry-\r^ - t2)«-V-2a 



(^setri={r^-t^)/{s^-t^)) 
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The last integral represents the hypergeometric function and can be 
evaluated using formulas 2.1.3(10) and 2.8.(6) from [E]. This gives 

and the result follows. The second formula in (2.9) can be obtained 
from the first one if we replace variables by their reciprocals. □ 

Remark 2.4. Formulas in (2.9), which express compositions of 
Erdelyi-Kober type integrals through the usual Riemann-Liouville in- 
tegrals, are not well-known. They occur in the more general context 
related to Gegenbauer transformations; cf. [D, p. 120, formula (4.19)], 
[vBE, Theorem 2.2]. These formulas play an important role in our 
consideration; see Remark 2.6. 

Fractional derivatives of the Erdelyi-Kober type can be defined as 
the left inverses V^ ^ = (-^±,2)"^- By (2.5), 

(2.10) Vl,^ = A-'VIA^, {Af){t) = fiVt), 

where the Riemann-Liouville derivatives can be chosen in different 
forms, depending on our needs. For example, if a = m + cto, m ~ 
[a], < CKo < 1, then, formally, (2.4) yields 

(2.11) vi,^ = (±D)-+^ ^ = ^ |- 

Inversion of 2 may cause difficulties. Let, for instance, a — 

m + ttoi m = [a], < ao < 1- Then the standard complementa- 
tion procedure, as in (2.11), can be inapplicable. Indeed, this formula 
assumes convergence of the integral /iys^V = /i-"°/"J"'7 = /"2 V 
or, equivalently, f{t) t^'^+'^ dt < 00. The latter is not guaranteed by 
(2.6), however, this obstacle can be circumvented. 

Theorem 2.5. Let (p = II ^ where f is a locally integrahle func- 
tion on satisfying (2.6). Then f{t) — {'D^2f){'t) for almost all 
t e M+; where T>'^ 2V has one of the following forms. 

(i) If a — m is an integer, then 

(2.12) ©V = (-0)>. 0=^|- 

(ii) If a — m-\- ckq, m — [a], < ckq < 1; then 

(2.13) ^ip = i2(l-a+m)^_^^m+1^2a^^ ^ ^ jl-a+m ^-2m-2 ^_ 
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Alternatively, 

(2.14) = 2-2" P^a ^ ja^^ ^-2a-l 

where D"^ denotes the Riemann-Liouville derivative of order 2a, which 

can be computed according to (2.4)- 

(iii) //, moreover, 1/(^)1^^"*''"^ dt < oo, then 

(2.15) P^^2V^ = 

Proof, (i) is obvious. To prove (2.13), we swap a with (3 in (2.8) 
to get 

(2.16) r+/ = t2"/^,2 t-^"^^^rj. 

The existence of t~'^'^ f is guaranteed by (2.6). Choosing /3 = 
1 — a + m, we obtain (2.13). To prove (2.14), we observe that the 
existence conditions for the Erdelyi-Kober type integral /"_2/ the 
Riemann-Liouville integral /^"/ coincide. Hence, (2.9) yields the result. 
Formula (2.15) follows from the semigroup property j^^o jm+ao _ 
n+^f owing to (i). ' ' □ 

Remark 2.6. An advantage of the inversion formula (2.14), which 
follows from (2.9), in comparison with (2.12), (2.13), and (2.15), is that 
it employs the derivative d/dt rather than D = {2t)~^d/dt = d/dt^. 
Similarly, the second formula in (2.9) yields 

+,2^ = 2 t I^2t ^■ 

In particular, ifa = /c/2, /cGN, then 

(2.17) V'J',^^2-H-'(J^j' 

k/2 ry^k { "\ + Tk/2 k-l 



(2.18) p!> = 2-^-^j tr^^^t— V- 

This observation will be used in inversion formulas for operators of 
integral geometry in the next sections. 

3. The A;-plane transforms 

Let n„_fe be manifold of all non-oriented A;- planes r in M"; Gn,k is 
the Grassmann manifold of A;-dimensional linear subspaces C, of M"; 
1 < k < n — 1. Each A';-plane r is parameterized by the pair (C,w) 
where C G Gn,k and m G C"*" (the orthogonal complement of C, in M"). 
Clearly, n„ ^ is a bundle over G„ ^ with an (n — /c) -dimensional fiber. 
The manifold n„ ^ is endowed with the product measure dr — d(^du, 
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where is the 5'0(n)-invariant measure on Gn,k of total mass 1, and 
du denotes the usual volume element on cf. [Matt, Chapter 3]. 
The /c-plane transform Rf of a function / on is defined by 

{Rf){T) = {Rm,u) = J f{u + v)dv 

C 

provided that this integral is meaningful. According to the general 
Punk-Radon-Helgason scheme, to reconstruct / from = Rf we need 
the following mean value operators 

(3.1) {MMr)= J f{x + nen)d^, r > 0, 

SO(n) 

(3.2) (i?»(r)= J ip{^R'' + x + nen)dj. 

SO{n) 

Here {Aix f){r) is the usual spherical mean of /, r'^ = Rei ® • • • © Mcfe, 
and (i?*(^)(r) averages (p over all /c-planes at distance r from x. 

Lemma 3.1. Let f be a locally integrable function onM.'^\{o}. If f 
is radial, i.e., f{x) = /o(|x|); then 

(3.3) (Rf)(T) = n'^/' (/%Vo)(r), r = dist(o, r). 
More generally, 

(3.4) {R:Rf){r) = 7r'/'{l'_{^MJ){r). 

These equalities hold provided that expressions on either side are finite 
when f is replaced by \f\. 

Formulas (3.3) and (3.4) can be found in [Ru04b, p. 98, 110] and 
[He, p. 118], where the notation for the Erdelyi-Kober operators is 
not used. The first formula is a particular case of the second one, 
corresponding to x = and / radial. 

Theorem 3.2. Let f be a locally integrable function on M"\{o}. // 
(3-5) I |{Mrf,<oo, 

\x\>l 

then {Rf){T) is finite for almost all r e n„fc. // / is nonnegative, 
radial, and (3.5) fails, then {Rf){T)—oo for every rell^fe- 
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Proof. Let fo{r) = f^^^^-^ /{rjCn) dj. Owing to (3.5), we have 

\fo{i^)\f^^^^ df^ < oo and, therefore, by Lemma 2.2, {I-^f{)){T) is 
finite for almost all r > 0. On the other hand, 

/ (i?/)(7(R' + re„)) = {R:Rf){r) = ^^'^ {l'.%){r). 

J x=0 

SO(n) 

Hence, {Rf){'-){R^ + re„)) < oo for almost all pairs (7,r) G SO{n) x 
M_i_. It means that (i?/)(r) is finite for almost all r G Iln,k- If) for 
nonnegative / = /o(|a;|), (3.5) fails, then fo{r) r''~^ dr = oo. Hence, 

Lemma 2.2 and (3.3) yield n''/^ {I-lfo) (r) = {Rf) (r) = oo. □ 

According to the general Punk-Radon-Helgason formalism, our next 
aim is to reconstruct {M.xf) ('") from the equality 

(3.6) {fJlMJ){r) = n-''\RlRf){r) 

(cf. (3.4)), and then pass to the limit as r ^ 0. We consider two 
classes of functions / satisfying (3.5). The first one, denoted by Cju(M"), 
consists of continuous functions of order 0(|a;|~'^). If > /c, then 
(i?/)(r) is finite for every r G T{n,k- The second class is U'ijsT'). If 1 < 
p < n/k, then by Holder's inequality, (3.5) is satisfied, and therefore, 
(i?/)(r) is finite for almost all r G Iln,k-^ The conditions fj, > k and 
1 < p < n/k arc sharp. It means that there are functions /i G C^(]R"') 
and /2 G L^(m") such that Rfi and -R/2 are identically infinite if n < k 
and p > n/k, respectively. For example, in the second case one can 
take 

''■'^ ^^W- i^g/tipTM) - i/p + i/p' = i. 

For this function, the integral on the right-hand side of (3.3) diverges. 
Lemma 3.3. 

(i) /// G C^(M"'), fjL > k, then for every x G K" andr > 0, the spherical 
mean {A4xf) (t^) can he recovered from </? = Rf by the formula 

(3.8) iMJ)ir)^7r-'/\v'J',Rl<p)ir), 

where the Erdelyi-Kober differentiation operator vt^^ can be computed 
by (2.12), (2.13), or (2.14). Under the stronger assumption /i > 2 + 
2[A;/2] (> k), V^_!\ can also be computed by (2.15). 
(n) If f e L'P{W^), 1 < p < n/k, then (3.8) holds for every r > and 
almost all x G K" with V^l^ computed by (2.12), (2.13), or (2.14). If 
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moreover, p < n/{2 + 2[k/2]) (< n/k), then v'i^l can also be computed 
by (2.15). 

Proof. We need to justify (a) the validity of (3.6) for our classes 
of functions, and (b) applicability of Theorem 2.5. 

(a) It suffices to verify convergence of {I-'^M.xf){^) in (3.6) for 
nonnegative f . II f & C^{W^), ji > k, then 

/df) 

where is finite. Hence, {I^2M.xf){^) < for every x and r. If 
/ e ]J>{R''), l<p< n/k, then' 



r 5"~i 



r(A;/2)(7„_ 



V<|y|<2r \y\>2r 



The first integral is finite for almost all x, because it has a finite L^- 
norm (use Minkowski's inequality for integrals). The second integral 
does not exceed 



c 

\y\>2r 

By Holder's inequality, it is bounded for all x when p < n/k. Thus, 
{I-'^M.xf){''^) < oo for every r > and almost all x. 

We have proved that (3.6) holds for every r > and all or almost 
all x, depending on whether / G or / G L^. 

(b) To obey Theorem 2.5, we have to show that {M.xf){t) is locally 
integrable on M+ and 

oo 

(3.10) J \{Mxfm\t'dt <oo, 

1 

where A = A; - 1 for formulas (2.12), (2.13), (2.14), and A = 2[fc/2] + 1 
for (2.15). If / G C^(m"), both statements are immediate consequences 
of (3.9) and the assumptions for /i. If / G i7'(M"'), p 7^ 1, then, for any 
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< a < 6 < oo and all x, 

b 



f \{Mjm\dt < J- / 



\fi'^-^-y)\ 



\y 



n-l 



dy 



a<\y\<b 



1/p' 



'a<\y\<b 



Similarly, 

\{M,f){t)\t^dt< 



I 




dy 



(n-A-l)p' 



\y 




'|J/|>1 

in view of the assumptions for A and p. If p = 1 the changes in this 
reasoning are obvious. 

To complete the proof, we note that Theorem 2.5 gives us {Aixf ){^) 
only for almost all r. However, if / G C^(M"^), then {M.xf){r) is con- 
tinuous (in both variables), and if / G //^(M"), then {Aixf){f^) is an 
L^-valued continuous function of r. It follows that the inversion for- 
mula (3.8) holds for every r > for both and spaces. However, 
in the first case it is valid for all x G K", and in the second case for 
almost all X. □ 

Lemma 3.3 and Theorem 2.5 imply the following theorem, contain- 
ing the main inversion results for Rf. 

Theorem 3.4. A function f G C^(K"'), /i > k, can be recovered 
from (fi — Rf by the formula 

(3.11) fix) = lim n-'^f'iV'J'.RWm, 

where the limit is uniform on R" and the Erdelyi-Koher differential 
operator V^J"^ can be computed as follows. 

(i) If k is even, then 

(3.12) V'JIF = {-Dfl^F^ ^ = YtJf 

(ii) For any 1 <k <n — 1, 

(3.13) V^J^F = i2-fc+2m(_^)m+l^fc^^ ^ ^ jl-k/2+m ^-2m-2 

where m — [k/2]. Alternatively, 

(3.14) V'J^^F = 2-'= (-^)' tl1ilt-'-'F 
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Under the stronger assumption n > 2 + 2[k/2] (> k), T>_ 2 can also he 
computed as 

(3.15) V^J^F = F. 

Note that (3.14) employs usual differentiation d/dt rather than D. 
The next theorem contains similar results for IZ-functions. 

Theorem 3.5. A function f E Lp{R"-), 1 < p < n/k, can he recov- 
ered from if — Rf at almost every x ER"^ hy the formula 

(3.16) /(x) = lim7r-^/^(P!(,X<^)(t), 

where the limit is understood in the U^-norm. Here Vt^^ ^-^ computed 
as in Theorem 3.4, where (3.15) is applicahle under the stronger as- 
sumption 1 <p < n/{2 + 2[k/2]). 

4. The Hyperbolic Space 

Let n > 2, be the pseudo-Euchdean space of points x — 

(xi, . . . , a;„+i) e M"'^-'^ with the inner product 

(4.1) [X, y] = -Xiyi - ... - Xnyn + Xn+Wn+l- 

We realize the n-dimensional hyperbolic space X as the upper sheet of 
the two-sheeted hyperboloid 

H" = {x e E*"'^ : [x,x] = l,Xn+i > 0}. 

Let S be the set of all A;- dimensional totally geodesic submanifolds ^ 
ofX,l<k<n — 1. As usual, Ci, . . . , e„+i denote the coordinate unit 
vectors. We set = © where 

K"-'^ = Kei © . . . © RCn-k, ^^^'^ = Re„_fc+i © ... © Ke^+i, 

and identify r''^^ with the pseudo-Euclidean space E'^'^. 

In the following = (0, . . . , 0, 1) and = n E^-^ = denote 
the origins in X and S respectively; G — SOo{n, 1) is the identity com- 
ponent of the pseudo-orthogonal group 0(n, 1) preserving the bilinear 
form (4.1); K = SO{n) and H = SO{n — k) x SOo{k, 1) are the isotropy 
subgroups of Xq and so that X = G/K, S = G/H. One can write 
f(x) = f{gK), (p{^) = (p{gH), g E G. The geodesic distance between 
points X and y in X is defined by d{x,y) — cosh~^[a;, y]. Each x E X 
can be represented in the hyperbolic polar coordinates as 



(4.2) 



X — ( sinh u -\- Cn+i cosh a;, 
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where C is a point of the unit sphere 5*"^^ in the plane Xn+i = and 
< a; < oo. In these coordinates the Riemannian measure dx on X 
has the form dx — sinh""^ u dujda{(), so that 

oo 

(4.3) J f{x) dx — J smli^'^ uduj J /{(sinh. u+Cn+i cosh u) da {(). 

X 5"-i 

In particular, if / is X-invariant (or zonal), that is, f{x) = /o(cosha;) = 
fo{xn+i), then 

oo 

(4.4) j fix) dx = J Ms){s' - ir/'-' ds. 



X 1 



The space L^(X) (with respect to dx above) is defined in a standard 
way; C{X) is the space of continuous functions on X; Co{X) denotes 
the space of continuous functions on X vanishing at infinity. We also 
define 

C,{X) = {/ e C{X) : fix) = 0{x-!t,)}. 

Of course, it might be natural to compare functions at infinity with 
powers of the geodesic distance d{xQ, x) (as in the case of M"), however, 
it is technically more convenient to use powers of Xn+i = cosh (i(xo, x). 

For X & X and ^ e S, we denote by fx and r^{E G) arbitrary 
hyperbolic rotations satisfying rxXo — x, r^^o — ^, and write 

/^(x) = /(r^x), ipxiO = f{rxO- 

The totally geodesic Radon transform {Rf){^) of a sufficiently good 
function / on X = H" is defined by 

(4.5) {Rf){0^ j f{x)d^x^ J f^{-fXo)d^, eeS- 

? 50o(fe,l) 

The first question is for which functions the integral (4.5) exists. 
Theorem 4.1. 

(i) Iffe LP{X), l<p<{n- l)/{k - 1), then (i?/)(0 is finite for 
almost all ^ G S. 

(n) If f e C^{X), n> k -1, then {Rf){0 is finite for all ^ eE. 
Proof, (i) We make use of the equality 
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which holds provided that either of these integrals is finite when / is 
replaced by |/|; see [BR04, p. 48]. By Holder's inequality the right- 
hand side does not exceed c where, by (4.4), 



oo 

f dx fii-iy^. 

^ / An-k)p' - '^"-l / s{n-k)p' 

X ^"+1 1 

The latter is finite if 1 < p < (n - 1)/(A; - 1). 

(ii) Consider an arbitrary fc-geodesic ^ G S. Let be the point 
in C, at the minimum distance from the origin xq and let x be an arbi- 
trary point in ^. Then the angle XqX^x is 90° and, by the hyperbolic 
trigonometry, see, e.g., [Rat, p. 102], 

(4.7) Xn+i = cosh (i(a;o, x) = cosh.d{xo,x^) cosh.d{x^,x). 

If / e C^{X), then, denoting = cosh d{xo,x^) and using (4.7), we 
obtain 

(4.8) \Wm<cj^^-cXr'j^^Jg^y 

Let 7 G G be a hyperbolic rotation that sends .^o to ^ and such that 
70:0 = x^. Changing variable x = jy, and using (4.4), we write the last 
integral in (4.8) as 



00 



ds. 

This integral is finite if > — 1. □ 

Remark 4.2. The restrictions > k — 1 and l<p< {n-l)/{k — l) 
are sharp; see Example 4.6 below. 

Now we introduce the mean value operators, which will be used in 
the inversion procedure. Let 



99 



cosh 6 sinh 9 

In-l 

sinh 9 cosh 9 



where is the unit matrix of dimension n — 1. Clearly, 
Qexo = ge^n+i = ei sinh 9 e„+i cosh 9. 
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The shifted dual Radon transform of a function 93 on S, which averages 
</? over all ^ e S at geodesic distance 9 from x, is defined by 



(4.9) (i?»(r) = J Mm%)dl, sinh^ 



r. 



K 



The case r = corresponds to the usual dual Radon transform. 
Given x e H" and s > 1, let 

foS _ 1^(l-n)/2 /• 

(4.10) (M,/)(s) = ^ > / f{y)da{y) 

{j/eH"; [x-,y]=s} 

be the spherical mean of / on X = H'^, where da{y) stands for the 
relevant induced Lcbcsguc measure. 

Lemma 4.3. [L, pp. 131-133], [BR99, Lemma 2.1]. 

(i) sup ||(M(.)/)(s)||p< 11/11^, feL^iX), l<p<oo. 

(ii) Iffe LP{X), 1 <p <oo, then lim || (M(.)/)(s) - f\\p = 0. // 

s—^l 

f G Co{X), then {Mxf){s) — )> f{x) as s ^ 1, uniformly on X. 
For our purposes it is convenient to set 

(4.11) {Mjm = (1 + t')-'/\MJ)iVlT¥). 
Then lim [Mtf){x) = f{x) as in Lemma 4.3. 

Lemma 4.4. Let f be a locally integrable function on H" \ {xq}, 
uj^d{xo,x), 9^d{xo,^). 
If f is zonal, f{x) = /o(cosha;) = fo{xn+i), and 

f,{t)^{i + t')-'/'fo{VT+¥), 

then 

oo 

r 

k /2 

(4-12) = (i + ^2)(.-i)/2 tf(2/o)(r), r = sinh^. 

More generally, 

k/2 

(4.13) (i?»(r) = ^^^l,^,,_,y, (I'JiMMr). 

These equalities hold provided that expressions on either side are finite 
when f is replaced by \f\. 
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Proof. It is known that for r = cosh.d{xo,^), 



(4.14) 



/-oo 



see [He, p. 121], [BR04, Lemma 3]. Changing variables 



s — 



we obtain (4.12). Similarly, 



oo 



T 



cf. [He, p. 128] and [Ru02a, formula (2.3)]. This gives (4.13). □ 

The following statement provides additional information about the 
existence of the Radon transform. 

Theorem 4.5. Let f be a locally integrable function on H" \ {xq} 
satisfying 



Then {Rf){^) is finite for almost all ^ E E . If moreover, f is non- 
negative, zonal, and (4-15) fails, then {Rf){^) — oo for every ^ G S. 

Proof. Let 



(4.15) 





^^+e„+is))d7, /o(i) = (l+i')-'/Vo(v^rTt^)- 



K 



Then (4.15) is equivalent to 



oo 



/ = 




a 



Indeed, setting s — gg^ 
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oo 
b 

oo 
b 

^ Cb — ——r—du I |/(7(ei sinh u + e„+i cosh a;))| 0^7 
J cosh (x; 7 



cosh"^ b K 



fix. 



a;n+i>t' 

Calculations in the opposite direction are similar. Thus, by Lemma 
2.2, if (4.15) holds, then (/^^2/o)(^) is finite for almost all r > 0. On 
the other hand, for r = sinh 6, Lemma 4.4 yields 



j{Rf){ige%)d-i^{Rl^Rf){T) 

K 



k/2 k/2 



Since {I^^fo){r) is finite for almost all r > 0, then {RDijOe^^o) < 00 
for almost all pairs (7, 9) & K x M+. It means that {Rf){^) is finite for 
almost all ^ G S. 

If, for / = fo{xn+i) > 0, (4.15) fails, then fo{t) t''-'^ dt = 00. 
Hence, by Lemma 2.2, (/^/2/o)(^) = 00 and, by (4.12), (i?/)(0 = oo. □ 

The following example of application of Theorem 4.5 shows that 
the restrictions 1 < p < (n — 1)/(A; — 1) and n > k — 1 in Theorem 4.1 
are sharp. 

Example 4.6. Consider the following functions 
(4.16) /i(x)- . fr'^^' f2(x)- 



l0g(l + Xn+l) ' log(l + Xn+l) 

By (4.4), 



00 

f c2 _ nn/2-1 
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However, if p > (n — 1)/ {k — 1), then (4.15) fails because 



/ 



Similarly, /2 G C^(H"), however, if < /c — 1, then 



ax = (Jn-i / r; — - — 7- r as = 00. 



/ < J ""^ ''''V log(l + s) 

x„+i>2 2 



As in the preceding section, our next aim is to reconstruct [M^f) (r) 
from the equality 

(4.17) {l'JiM,f){r) = iT-''/\l + rY-'^^'\KRf)ir) 
(cf. (3.6)) and then pass to the limit as r — >■ 0. 

Lemma 4.7. Let X = H". 

(i) If f & Cfj,X), fi > k — 1, then for every x & X and r > 0, the 
spherical mean {Mxf){r) can be recovered from (f — Rf by the formula 

(4.18) (M./)(r) = n->'/'{V'/',{l + r^-'^/'R^ir), 

where the Erdelyi-Kober differentiation operator vt^l is computed by 
(2.12), (2.13), or (2.14). Under the stronger assumption ^ >2[k/2\+l, 
V^^l can also be computed by (2.15). 

(ii) ' IffeLP{X), l<p< {n-l)/{k-l), then (4. 18) holds for every 
r > and almost all x E X with computed by (2.12), (2.13), or 

(2.14). If, moreover, p < (n — l)/(2[A;/2] + 1), then V^J^ can also be 
computed by (2.15). 

Proof. As in Lemma 3.3, we first show (a) convergence of [I^^Mr^f) ( 
for nonnegative /, and (b) applicability of Theorem 2.5. 
(a) We have 

00 

/ ^ (/!(2M./)(r) < c j {M,f){t){e - r^/'-Hdt 

r 

00 

= cJ{MJ){s){s'-p')'/'-Us, p^Vl + 
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Setting s = coshcu, p = cosh6', and denoting fx{y) = fi^xV), where 
7j; e G, 7j;Xo = X, we continue: 

oo 

/ < c j {cosh^u-cosh^ef^-^ smh^-"ujduj j f{y)da{y) 

6 [x,y]=cos'hijj 
oo 

= c y" (cosh^ CO - cosh^ 61) '^/^-i ginh u dw 
e 

X j /a;(Csinha; + e„+i cosho;) 
By (4.3) this gives 

yn+l>P 

This integral has a structure of the hyperbohc convolution 
{Kf){x)^ j f{y)k{[x,y])dy^ j fMHyn-ti) dy, 



which can be "lifted" to a convolution operator on G. By Young's 
inequality [HR, Chapter 5, Theorem 20.18], 



(4-20) \\Kf\\, < 

where 1 < p < q < oo, 1 — + — r~^, 



/oo 
\k(t)\^ {e-ir'^-'dt. 



We split the integral in (4.19) in two pieces / = Ji + /2, corresponding 
to p < yn+i < 2p and yn+i > 2p, and consider the cases / e Ci^{X) 
and / G LP{X) separately. 

In the first case, when f{y) < cy~!^i, we have 

j^^^ , {yl^r-p'f"-' dy 



I 



P<yn+i<2p 



20 



BORIS RUBIN 



This integral can be estimated using (4.20) with r = 1, p = q = oo, as 
follows: 1 1 < cA, where 

P<!/n+l<2p 
2p 



c an-i j {s^ - p'f'^-Us < OO Vp>l 



p 



(the last equality holds by (4.4)). To estimate /2, we apply (4.20) with 
r = and ? = oo, to get h < cB^/pC^/p', 



(4.22) B^jy-lldy, C= j 



dy. 



X 2/„+i>2p 

The first integral is finite if p > (n — l)//x, whereas the second one is 
finite (for every p > 1) if p < {n — l)/{k — 1). Since both conditions 
are consistent when /i > k — 1, we are done. 

Consider the case / e Lp{X) and estimate Ii by using (4.20) with 
r = 1, p = q. This gives ||/i||p < where A has the form 

(4.21). For I2, we apply (4.20) with r = p' and q = 00, so that 
I2 < cCVp'II/IIp, where C is the same as in (4.22). It follows that, for 
1 < p < (n — l)/(/c — 1), / is finite for almost all x and all p > 1. 

(b) To justify apphcability of Theorem 2.5, we have to show that 
(Mxf) (t) is locally integrable on IR+ and 

00 

(4.23) iPix) = J \{MJ){t)\t^dt< 00, 

1 

where A = A: - 1 for formulas (2.12), (2.13), (2.14), and A = 2[A;/2] + 1 
for (2.15). Proceeding as in Part (a) of the proof of Lemma 4.7, for 
any 0<a<6<oowe obtain 





j \{MJ){t)\dt<c j I/, 



dy, 



a ai<2/„+i<6i 

for some 1 < ai < 61 < 00 depending on a and h. 

If / G C^(X), > 0, the last integral is bounded uniformly in x 
because \fx{y)\ < c^i^y, Cn+if^ and [7a;y, e„+i] > 1. If / G ^{X), 
then, by (4.20) (with r = 1, q = p), the L^-norm of this integral 
does not exceed c ||/||p. Hence {Mxf){t) is locally integrable on R+ for 
almost all x. 
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Similarly we get 

oo 

i^ix) ^ J mjrni t'dt<c J {yl^, - lf^^'-''^^'\fM\ dy. 



y„+i>\/2 



If / e L^(X), then, as above, iIj{x) < cc^^ \\f\\p, where, for p > I, 

/POO 
ivu. - ir^'-^^''^ dy = <7„_, - lyi- ds, 

yn+i>V2 

6 — {X + 1 — n)p' + n — 2. The last integral is finite provided that 

V<(n-l)/X-l ifA = A:-l, 

p<[n ij/A - I _ i)/(2[^/2] + 1), if A = 2[k/2] + 1. 

If j9 = 1, then iIj{x) < c ||/||i if A < n — 1. In the case A = A; — 1 
this inequality does not restrict the range of k. If A = 2[A;/2] + 1, then 
A < n — 1 is equivalent to [k/2] < n/2 — 1 and the case k = n — 1 with 
n odd must be excluded. 
If /eC^(X),then 

j/„+i>\/2 

where B is the integral from (4.22), which is finite if p > (n — 1)//^, 
and cx is known from (4.24). It is finite if p < (n — 1)/A. Thus, we 
have to choose {n — l)//! < p < (n — 1)/A, which is possible if /i > A. 
If A = /c — 1 we arrive at the "standard" assumption fi > k — 1. If 
A = 2[A;/2] + 1, we get the new restriction > 2[A;/2] + 1, as stated in 
the lemma. 

To complete the proof, we note that Theorem 2.5 gives us (Mr/)(r) 
only for almost all r. However, if / G C^(X), then (M^/)(r) is con- 
tinuous (in both variables), and if / G L^{X), then {Mxf){r) is an 
L^- valued continuous function of r. It follows that the inversion for- 
mula (4.18) holds for every r > for both C^^ and spaces. However, 
in the first case it is vahd for all x G X and in the second case for 
almost all X. □ 

Lemma 4.7 and Theorem 2.5 yield the main results for X — H", 
which mimic those for X — R"'. 

Theorem 4.8. A function f G C^(X), ^> k — 1, can he recovered 
from </? = Rf by the formula 

(4.25) f{x)^\iu.n-'l\v'!lRl^){tl 



t->o 
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in which the limit is uniform on X and the Erdelyi-Koher differential 
operator V^^"^ can he computed as follows. 

(i) If k is even, then 

(4.26) V'JlF = {-Dfl'F, ^ = kjf 

(ii) For any 1 <k <n — 1, 

(4.27) P^/^^ = e-''+^"\-DY'+H''il^, = t-^'"-^ F, 
where m— [k/'2\. Alternatively, 

(4.28) V^'JIf = 2-'= (-^y tl1{^t-'-'F 

Under the stronger assumption n > 2[k/2] + 1, v'^^l can be also com- 
puted as 

(4.29) vt^^^F = F. 
For L^-functions we have the following. 

Theorem 4.9. A function f e Lp{X), 1 < p < {n - l)/{k - 1), 
can be recovered from ip — Rf at almost every point x by the formula 

(4.30) f{x) = ^n.iT-''\v'!lR:^){tl 

where the limit is understood in the L^-norm. Here v't^l is computed as 
in Theorem 4-8, where formula (4-29) is applicable under the stronger 
condition l<p<{n- l)/(2[A;/2] + 1). 



5. The case X ^ S"" 

We recall some basic facts [He, Ru02b]. Let M"+^ = m'=+^ x M""*^, 

m'^+i = Mei © . . . © MCfe+i, K""^ = Refc+2 © ... © IRe„+i; 

o-„ = |^"| = 27r("+i)/Vr((n + l)/2); = is the unit sphere in 
d{-,-) denotes the geodesic distance on 5*"; G = SO{n + 1); 
K = SO{n) and K' = SO{k + 1) x SO{n - k) are stabilizers of e^+i 
and ^0 respectively. The set S of all /c- dimensional totally geodesic sub- 
manifolds ^ of X = S*" can be identified with the Grassmann manifold 
G'n+i,fc+i = G/K' of all {k + l)-dimensional linear subspaces of M"+^. 
The G-invariant probability measure d^ on 5 is defined in a canonical 
way. 
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The totally geodesic Radon transform of a sufficiently good 

function / on is defined by 



(5.1) {Rfm = j fi^)dix, 



where d^x stands for the usual Lebesgue measure on C,- Clearly, if / is an 

odd function, then Rf = 0. We wiU be deafing with Lp{X) = Lp(5"), 

the subspace of even functions in U'{S'^). 

Another important object is the shifted dual Radon transform, 

which averages a function (/? on S over all fc-geodesics ,^ at a fixed 

distance from a; e 5". To define this operator, we denote by Tx G 

SO{n + 1) an arbitrary rotation satisfying rxQu+i = ^ and set (pxiC) — 

(fi{rxC)- For d e [0, 7r/2], let ge be the rotation in the plane (e^+i, e„+i) 

. , , , , , . sin ^ cos 9 
with the matrix 



— cos U sm U 
For r = cos 9, the shifted dua^ 
S is defined by 



Radon transform of a function if on 

(5.2) (i?»(r) = J (^(0 dfiiO = J MP9e%) dp- 

d{x,€,)=e K 

The case 9 = Q corresponds to the usual dual Radon transform [He]. 
This definition is slightly different from the similar one for the hyper- 
bolic space, however, it allows us to avoid unnecessary technicalities. 

Lemma 5.1. [Ru02b, p. 479] For alll<p< oo, 

WRfWip) < ^n'/1l/ll., \\{Rhv){r)\\p < 

where \\ ■ and \\ • \\p denote the -norms on S and X — S'^, respec- 
tively. 

We need one more averaging operator: 

(5.3) (M,/)(.) = ^ > / f{y) da{y), s E (-1, 1). 

{2/eS": x-y=s} 

The integral (5.3) is the mean value of / on the planar section of S*" by 
the hyperplane x ■ y = s, and da{y) stands for the induced Lebesgue 
measure on this section. It is known that ||(M(.)/)(s)||p < ||/||p and 
lim(Ma,/)(s) = f{x) in the iZ-norm for all 1 < p < oo.^ 

s— >^l 



^Here and on we identify L°°{S"') with the space C(5") of continuous functions. 
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Lemma 5.2. Let f e 1 < p < oo. Then 

2ak- 



^ Jo 



(5.4) 



27]-fe/2 

{li%)ir), 9.{s) = «-^(M./)(.). 



This statement can be found in [He, p. 140] and [Ru02b, p. 485]. 
Note that, by Lemma 5.1, (i?*i?)(r) represents a bounded operator 
on If for every r e (0,1). Hence, the integral (5.4) is absolutely 
convergent for every r G (0, 1) and represents an L^-function of x. 

Lemma 5.2 implies the following inversion result. 

Theorem 5.3. Let X = 5". A function f e Lp{X), 1 < p < oo, 
can be recovered from ip = Rf by the formula 



(5.5) /(a;) = lim ( — ^ 



In particular, for k even, 



-k/2 



r{k/2) 



.2\k/2-l 



{Rl^){T)T^dr 



1 



k/2 



-^k-l 



Altenatively, 



(5.7) /W = l.m|| 



2-k ^-k/2 

r(fc/2) 



{s'-r')'f'-\R:^){r)dr 



The limit in these formulas is understood in the IP-norm. If f & 
Ce{X), it can be interpreted in the sup-norm. 

Proof. By (5.4), 

(4&.)(r) = ^x(r), ^.(r) = 2-\-'l\'-\Rlip){r). 

Hence, by the semigroup property (2.7), lX,29x — 1+^2'^x, and therefore, 
gx = D'^I^^ip^j,, D = (l/2s) (d/ds). This gives the first two formulas. 
Furthermore, by (2.17), 

{MJ){s) = 2-^-V-^/^ {l'i2R»{s), 
and the third formula follows. □ 
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We observe that the first two formulas in Theorem 5.3 are well 
known for infinitely differentiable functions; cf. Theorem 1.22 in [He, 
p. 141]^. The third formula, containing usual derivative {d/dsY, is 
new. 



6. On Helgason's formula. Open problem 

The following interesting result is due to Helgason [He, p. 116]. 

Theorem 6.1. If k is even, then the k-plane transform on can 
be inverted by the formula 

(6.1) f{x)^c[d^{R:Rf){r)]^^^, const, 9. = |: ■ 

This formula is much simpler than those in Theorem 5.3. The 
constant c in (6.1) was explicitly evaluated in [AR], where Theorem 6.1 
has been extended to totally geodesic Radon transforms on arbitrary 
constant curvature space X. To state this result, we introduce the 
distance function 

( d{x,0 if X = K", 

(6.2) p{x, = < sinh d{x, H X = H", 

[sinci(x,0 ifX = ^". 

The corresponding shifted dual Radon transform can be defined by 

(6.3) (i?»(r)= j <p{Odm: ^^X, r>0, 

where dix{^) is the relevant normalized canonical measure. 
Theorem 6.2. Let ip = Rf. If k is even, then 

(6.4) d',Xx{r){R:^){r) = cx f{x), 

r=0 



where 



1 if X ^ M", 

X^(r) = <[(! + r2)('=-i)/2 if X = H", 



Cx 



2{-l)'^/\k-l)\ak-i ifX^S 



n 



^Coincidence of the constants in both theorems foUows by duphcation formula 
for gamma functions. 
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In both theorems it was assumed that / is infinitely smooth and 
(for X — R",HI") rapidly decreasing. This assumption is redundant. 
See Appendix, where, for X = K", it is shown that the result holds 
under much weaker asumptions. 

Open Problem. Extend Theorems 6.1 and 6.2 to non-differentiable 
functions, e.g., f G U\X). 

Helgason's idea to invoke usual differentiation in place of d/dr"^ 
agrees with the 1927 paper by Mader [M] in the sense that her inver- 
sion formula for the hyperplane Radon transform also contains usual 
differentiation. However, the method of [M] is completely different. 
For the sake of completeness, we present without proof a generaliza- 
tion of Mader's result, which was obtained in [AR]. 

For r > and 1 < /c < n - 1, let 

(6.5) (L» (r) = y (^(0 p'^'-'' sgn(p -r)di, 



(6.6) 



(L»(r) = j ^ii) p^+i-- log |p2 _ dC, 



where p — p{x,^) is the distance function (6.2). 

Theorem 6.3. Let (p = Rf , where f is a C°° function, which is 
rapidly decreasing in the case X = R", H". 



(i) // k is even, then 

(6.7) d^^\L*M{r) 

where 



r=0 



= dxf{x), 



d, 



2(-i)(fc+2)/2^„_,_,afc_i(fc-l)! tf X 



^ ^ 2 an-k-i CTk CTfc-i {k - l)!/cr„ if X = S""' 
(ii) If k is odd, then 



(6.8) 
where 



d',^\Ll^){r) =dxf{x), 



r=0 



d 



X 



r 7r(-l)(^-i)/V„_fe_iafc_i(A;-l)! X = M",H", 

\ 27r(-l)('=-i)/2a„_fc_i(7fc(7fe_i {k - ly./an if X^ 
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7. Appendix 

Let us prove Theorem 6.2 for the case X = R"'. We provide more 
details, than in [AR], and make assumptions for / more precise. For 
> and A; e N, let 

Cj(R") = {/ e C^(R") : \d"f{x) = 0{\x\-^) V |a| < k}. 

Proposition 7.1. Suppose that l<k<n-l, ii>k. Then a 
function f e C^(K") can be reconstructed from (p — Rf by the formula 



(7.1) /(x) = lim c, (i?»(r), c,= - . 

r^-O (fc-lj!cTfe_i 

where the limit is uniform on M". 

Proof. Fix x and write (3.4) in the form 

{R:^){r)^a,^^[A{r) + B{r)], 

where 



yl(r) = j{MJ)(t){f-r'f'^-'tdt, 





r 



i?(r) = j{Mjm {r^-t^l^-Hdt. 



Since A(r) is a polynomial of degree k — 2, then 9^A(r) = 0. Regarding 
B{r), we write it as Bi + B2, where 

r 

Bi^fix) J{r'-t')'/'-Hdt^jf{x), 


r 

B2 = J (r^ - t')'/'-'[iMtf)ix) - fix)]tdt = r'h{r), 



h{r) = y (1 - t')'/'-'[{Mrtf){x) - f{x)]tdt. 


Clearly, d^Bi = {k — 1)1 f{x). Furthermore, 



k 



hm.dtB2 = cAimr^h^^Hr). 

j=0 
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The term corresponding to j = is obviously zero. Other terms arc 
also zero because W\r) is uniformly bounded. Indeed, 

\h^\r)\ < 



< 
< 

Thus, \\md^B-2{r) = 0, and the result follows. □ 

r— >^0 
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